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Experimental studies have shown the ubiquity of altruistic behavior in human so- 
cieties. The social structure is a fundamental ingredient to understand the degree 



CN ■ of altruism displayed by the members of a society, in contrast to individual-based 
> , 

, features, like for example age or gender, which have been shown not to be relevant to 
!>■ . 

\ determine the level of altruistic behavior. We explore an evolutionary model aiming 

lO ' to delve how altruistic behavior is affected by social structure. We investigate the dy- 

o 

namics of interacting individuals playing the Ultimatum Game with their neighbors 
given by a social network of interaction. We show that a population self-organizes 

•rH . 

^ ' in a critical state where the degree of altruism depends on the topology character- 

ed ' 

izing the social structure. In general, individuals offering large shares but in turn 
accepting large shares, are removed from the population. In heterogeneous social 
networks, individuals offering intermediate shares are strongly selected in contrast 
to random homogeneous networks where a broad range of offers, below a critical one, 
is similarly present in the population. 
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I. INTRODUCTION explanation of cooperation as it emerges if al- 

truistic punishment is possible, while breaks 
How cooperative behavior emerges among down if it is ruled out 0. The ultimatum 
interacting individuals is a long-standing game consists of two agents, who have to 
problem that has attracted, starting from share a given amount of money. One of them, 
Darwin, the attention of a large number of the proposer, makes an offer on how to share 



researches 



m 



29|. In the context of Game the money to the other agent, the responder. 



Theory, different mechanisms and models The proposer can only make one offer. The 
have been proposed to explain the observed responder decides whether he accepts or re- 
cooperative behavior, two prominent exam- jects the offer. If the responder accepts, the 
pies being the Ultimatum Game (l2j and the money is shared as proposed; otherwise, none 



Prisoner's Dilemma [3]. Theoretical studies, of them get anything. Given that a narrowly 
have shown that, selection at the individual rational responder would accept no matter 



level, may lead to altruistic behavior |3l|, in what he has been offered -something is bet- 
contrast to the general behef that only group ter than nothing-, a narrowly rational pro- 
selection can give raise to altruism. Poser would offer to the responder the min- 
imum amount. However, real agents behave 
differently: offers are typically close to a SO- 
SO ratio and offers below 20% are typically 



Aiming at understanding the mechanisms 
leading to altruism as the core of cooperative 
behavior, the Ultimatum Game is one of the 
paradigmatic theoretical games used to un- 



rejected 
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J J- J j-u • • J- w rrr, • r Recently, an extensive research performed 

derstand their mterrelation. Ihe simphcity ^ i — i 

r 1 11 J J. uj- • 1 i. among small societies around the world tl6| 

of this game has allowed to obtain a large set ^ 

r ■ ,1 ii ii, i 1 1 u ii, has shown that social structure is a key el- 
ot experimental results that clearly show the 

f ii • u 1, • ■ c ement in determining the degree of cooper- 

presence of altruistic behavior, m the form ° i — i ^ 

r u ■ J.- I. 4 Aij- • -1, ation among its members 13, uM. On the 

of altrmsnc punishment. Altruistic punish- ^ ' — ^ — ^ 

. . one hand, individual-based features seem not 

ment, meaning that individuals react to an ' 

r ui u ^ UT, u to be relevant in order to determine the de- 

untavorable action by an opponent although 

. , , . ,1 r ,1 J • ij gree of cooperation. On the other hand, in 

the punishment is costly tor them and yields 

, . , . . 1 . J- i r j-t, the Ultimatum Game, the proposals and re- 
no material gam, is a key ingredient tor the 

jection levels are different depending on the 

■^Electronic address: ltessonec@ethz.chl social structure. For example, societies based 

URL: |http : //www . imedea . uib . es/'^tessonec| on cooperation and sharing of food, show 
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higher offering levels. From the theoretical 
point of view the effect of structured popula- 
tions in social dilemmas, e.g., the prisoner's 
dilemma, public good games, or snowdrift 
games, has been analyzed mainly from the 
perspective of spatially extended populations 
3, 0]- In the simplest case, local in- 
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teractions are considered in regular lattices 
where each individual interacts only within 
its local neighborhood in contrast to global 
random interactions considered in well mixed 
populations. However, recent progress in this 
area has shown that many social and biolog- 
ical interaction networks are not regular, as 
typically used in theoretical models, but dis- 



play the small-world be^ 



gree distributions 



lavior and broad de- 
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The question we address here is precisely 
how social structure affects the degree of al- 
truistic behavior. This paper is organized 
as follows: In the next Section we define 
the evolutionary ultimatum game model in 
a complex network. In Section llllt follow- 
ing the tradition of spatial games, we first 
consider interactions given by a regular lat- 
tice; later extending our analysis to random 
and small- world networks, which are charac- 
terized by single-scale degree distributions; 
in Section IIII Bl we also consider scale-free 
networks. Finally we discuss our results and 
draw the conclusions in Section [IVl 
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FIG. 1: For each time step, a data point indi- 
cates the threshold of the agent with the low- 
est payoff. The population is composed of 10^ 
agents who interact in a one-dimensional lattice. 

II. THE MODEL 

A set of agents are arranged in the 
nodes of a network. We set 1 unit the 
amount to be shared in each interaction. 
Each agent i is characterized by a threshold 
Tj G [0, 1]: as responder it indicates the min- 
imum amount he will accept; as proposer, it 
also defines the amount of money he will of- 



lis situation is usually named as em- 



fer. T 

pathy [30||, and has been shown to enhance 
fairness in some situations in the ultimatum 

game 
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3l| . Based on experimental 
evidence reported previously, we will assume 
that a fair offer-acceptance (threshold values 
around 50%) represents altruistic behavior. 

The model runs as follows: at each time 
step all agents play with all their neighbors 
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synchronously. Thus for each interaction hnk 3 
between two neighboring agents 



• If the offer Tj is above the threshold of 
agent j, Ti > Tj, then the offer Tj is ac- 
cepted: agent j increases his payoff by 
Ti while agent i's payoff increases by 
1 — Tj. The payoff obtained by agent i 
{j) from the interaction with his neigh- 
bor j (i) is Uij = 1- Ti (Uji = Ti); 

• Otherwise if the offer Tj is above the 
threshold of agent i, Tj > Ti, then the 
offer Tj is accepted: agent i's payoff 
increases by Tj while agent j's payoff 
increases by 1 — Tj. The payoff ob- 
tained by agent i (j) from the interac- 
tion with his neighbor j (i) is Uij = Tj 

(n,, = i-T,). 

The payoff obtained by agent i after inter- 
action with the neighbors j in his neighbor- 
hood V(i) is thus Hi = J2jev{i)^ij- fhe 
unlikely event that two neighboring agents 
thresholds are the same, one of the offers is 
selected and accepted at random. After each 
round, a selection rule is applied to the sys- 
tem: the agent with the lowest payoff in the 
population and its immediate neighbors, de- 
termined by the network, are replaced by new 

n 

agents with randomly chosen thresholds [5[. 
We then let the system evolve resetting the 
payoffs of all agents to zero. 




FIG. 2: Distribution of thresholds for 10^ agents 
in a one-dimensional lattice (continuous line) 
and in a random network (dashed line) after 
4 X 10^ iterations. The dynamics selects thresh- 
old values below the critical threshold Tc = 0.56 
in the one-dimensional lattice and Tc = 0.88 in 
the random network. 

An alternative description of the model 
could set the interaction between two agents 
as a single event in which agent i acts as pro- 
poser and j as responder. However as long 
as the update is synchronous and every agent 
plays as proposer and responder with all its 
neighbors, this description and the dynamic 
rules (i)-(ii) are equivalent. 

III. RESULTS 
A. Single-scale interaction networks 

Following previous studies of spatial 



games 



20 



22 



32| . we first consider a one- 
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dimensional lattice where each agent inter- 
acts with his two nearest neighbors. We have 
run simulations for populations in the range 
= 10^ to 10^ agents, finding consistent re- 
sults. The initial thresholds are randomly 
selected from a uniform distribution in the 
range [0, 1]. In Fig.[T]we display the threshold 
of the agent with the lowest payoff in the pop- 
ulation at each time step. Agents with high 
and low thresholds are removed from the pop- 
ulation. On the one hand, agents with high 
thresholds make large offers that are likely to 
be accepted by their neighbors, contributing 
to the neighbors payoff. However quite un- 
likely they receive large enough offers to be 
accepted due to their high threshold. This 
behavior can be illustrated calculating the ex- 
pected payoff per interaction in a completely 
mixed population, 

(n(T)) = r(i - T) + . (1) 

In the limiting case of agents with threshold 
T = 1, they obtain on average a payoff close 
to 0. On the other hand, the opposite situ- 
ation is observed for agents with low thresh- 
old: their offers are hardly accepted while 
they accept most of the offers they receive. 
In the limiting case of agents with thresh- 
old T = 0, they obtain on average a payoff 
close to 1/2 per neighbor. Thus agents with 
low thresholds have in average a larger pay- 
off than agents with high thresholds and are 



able to survive. Although the previous ar- 
gument has been obtained for a completely 
mixed population, we observe that it is still 
valid in the regular case (Fig. [2]). Thus, af- 
ter a transient, the distribution of thresholds 
reaches a stationary distribution. Thresholds 
above a critical value are removed from the 
population. For the one-dimensional lattice 
considered here, a critical threshold value is 
obtained Tc = 0.56 ± 0.01. Below this criti- 
cal value the distribution of thresholds is not 
uniform: it increases approaching the critical 
value. The payoff distribution also shows a 
nonuniform distribution: only values above a 
critical value He = 1.76 are found, displaying 
a maximum at a value around 11 ~ 2. 

The question we next address is whether 
the ultimatum model self-organizes in a crit- 
ical state. In order to characterize the dy- 
namics, we have measured the distribution 
of the distance Ax between two consecutive 
selection events, C{Ax), and the first return 
time distribution, Pf{t), the time elapsed be- 
tween two selection events affecting the same 
agent. The results are plotted in Fig. [31 In 
both cases the tails of the distributions are 
well fitted by power-laws. For the spatial cor- 
relation 

C{Ax) ~ Ax~^ , (2) 

with 7 = 3.16±0.1, and for the first return 
time 

m) - 1-- > (3) 
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FIG. 3: First return time distribution for a sys- 
tem of 10^ agents in a one-dimensional lattice. 
The solid line is a power-law fit with an exponent 
a = 1.57. Inset: distribution of the distance 
Ax between two agents getting the lowest pay- 
off consecutively. The solid line is a power-law 
fit with an exponent 7 = 3.16. 

with T = 1.57. 

These results suggest that the system self- 
organizes in a critical state where the dis- 
tribution of avalanches is also a power-law. 
The critical state would emerge despite the 
nonuniform distribution of thresholds (and 
payoffs). An avalanche is typically defined as 
follows: it starts when the lowest payoff gets 
larger than a preset value H* (close to the 
critical payoff), and stops when it drops be- 
low this value. The size, s, of an avalanche is 
the number of time steps it lasts. In Fig. HI 
we show the distribution of avalanche sizes 
when we use a payoff 11* = 1.76 as the indi- 
cation of an avalanche. The probability dis- 



FIG. 4: Avalanche size distribution P{s) a sys- 
tem of 10^ agents in a one-dimensional lattice 
(circles) and in small-world networks (squares) 
with a rewiring probability p = 0.15. The solid 
lines is a power-law fit with an exponent a = 1.0 
and a = 1.5, respectively. Inset: the avalanche 
size distribution P^{s) considering the thresh- 
olds instead of payoffs for the definition of an 
avalanche in a one-dimensional lattice. The solid 
line corresponds to the best exponential fit. 

tribution displays a power-law decay 

Pis) ~ (4) 

with an exponent a = 1.0. 

It is worth noting that if we had used the 
threshold value, T, as an indication of when 
an avalanche starts and stops, the distribu- 
tion of avalanches would have decayed expo- 
nentially (see inset of Fig. H]). This behavior 
reflects that the thresholds being removed are 
not always above a critical value (as shown 
in Fig. [1]): agents with low thresholds are re- 
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FIG. 5: (a) Distribution of payoffs and (b) distri- 
bution of thresholds for 10^ agents in a scale-free 
network in the asymptotic state after 10^ itera- 
tions. The distributions are averaged over 100 
realizations. 

moved often from the population. Thus, the 
fitness of an agent is given by its payoff. 

Regular lattices are just a crude simpli- 
fication of social and biological interaction. 
More realistic models of interaction networks 
include the small-world behavior: the aver- 
age distance between agents in the network 
is similar to the one obtained in a random 
network, and the clustering, the fraction of 
neighbors of an agent that are also neighbors 
between them is large, as occurs in a regular 
lattice. We have performed simulations in 



small-world networks generated by rewiring 
the links of a one-dimensional lattice, using 
the algorithm introduced in Ref. 2l|] in or- 
der to keep all the agents with the same 
number of links: With a probability p, two 
edges exchange their end nodes. The distri- 
bution of thresholds and payoff are similar 
to the one-dimensional lattice, as shown in 
Fig. O It can be seen that for the limiting 
case of a random network, the distribution 
of thresholds is broader, and has a higher 
critical threshold. In this case, the system 
also self-organizes in a critical state where the 
avalanche size distribution displays a power- 
law scaling. Similarly to the one-dimensional 
lattice, the avalanche size distribution (when 
considering the threshold as the dynamical 
variable) is not power-law, but exponential. 
For the small-world networks, the distribu- 
tion of avalanche size is also power-law with 
an exponent that depends on the rewiring 
probability p. For instance, for a system of 
10,000 agents we find an exponent a = 1.5, 
for a value p = 0.15 (Fig. H]). 

B. Scale- free interaction networks 

In all the results presented so far, the net- 
work of interactions is such that the number 
of links of each node, its degree, is constant 
for all the agents. Beyond the small-world 
behavior, another important ingredient of in- 
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FIG. 6: The cumulative distribution of 
avalanches in a scale-free network with 10^ (cir- 
cles) and 2 x 10^ agents. The distribution is well 
fitted by a power-law with an exponential cut- 
off. The solid line corresponds to a power-law 
fit, leading to an exponent a = 1.62. The preset 
payoff that defines when an avalanche starts and 
ends is 11* = 1.77. Averages are obtained over 
100 realizations. 

teraction networks is that they often display 
a scale-free degree distribution. We now turn 
into the study of the results of this model 
when the topology of interactions is not a reg- 
ular one, but a scale-free one. As the model 
for the generation of the network, we used the 
Barabasi- Albert algorithm j^, 3], generated 
as follows: starting from a fully connected 
network of size m, at time t a node is added, 
and attached to m existing nodes, where the 
probability to be attached to a node is pro- 
portional to its degree. This algorithm gen- 
erates networks with a power-law degree dis- 



tribution with an exponent 7 = 3. We have 
fixed the value m = 2. Once the network is 
grown, it is kept fixed and the dynamics is 
played as indicated by rules (i) and (ii). 

In Fig. [5](a) we plot the stationary distri- 
bution of payoffs in the population. There 
is a well defined critical payoff, below which 
the agents are removed. This critical value 
is He = 1.75 ± 0.02. For large payoffs, the 
distribution decays as a power-law with an 
exponent of 3, reflecting the decay of the 
degree distribution of the network. For the 
distribution of thresholds in the population 
(Fig. El^b)), there is not cutoff in this dis- 
tribution. All thresholds in the range [0, 1] 
are present, with a maximum in the distri- 
bution around T ~ 0.5. The distribution 
is highly asymmetric: it approaches zero for 
thresholds close to 1, while it reaches a finite 
fraction in the limit T ^ 0. Thus, agents 
with low threshold values have more chances 
to survive. This is in agreement with the 
analytical argument in Eq. [H In scale-free 
networks, the system also exhibits a power- 
law distribution of the size of the avalanches 
(Fig. E]). In this case, the payoff we set to 
define an avalanche is 11* = 1.77 obtaining 
an exponent r = 1.62 for the a power-law 
scaling. 

Why can in the scale-free network agents 
with high thresholds survive better than in a 
regular or random network? To address this 
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FIG. 7: Average degree d of agents having a 
given threshold T when 10*^ agents interact in a 
scale-free network. Averages are obtained over 
50 realizations. 

question we have analyzed the average de- 
gree of the agents grouped according to their 
threshold, and the results are shown in Fig. [71 
It can be seen that agents with high thresh- 
old values are more likely to survive if they 
are located at the hubs of the network. The 
reason for this is that they can accumulate 
payoff via interaction with a large number of 
agents. 

It is worth noting that when the network is 
highly heterogeneous, for example when the 
degree distribution is scale-free, the dynamics 
depends on whether the payoff of each agent 
is normalized by its degree. For normalized 
payoffs in the scale-free networks described 
previously the critical threshold depends on 
the number of agents A^. In the limit of 
large the critical threshold tends to 1, in 



contrast to the system size independent crit- 
ical threshold reported previously, and the 
dynamics displays power-law distribution of 
avalanches when the threshold used to define 
an avalanche is chosen depending on A^. A 
deeper analysis of the normalized payoff case 
goes beyond the scope of this paper. 

IV. DISCUSSION AND 
CONCLUSIONS 

How cooperation and altruism emerge 
among individuals is a withstanding question 
that has attracted much attention in the last 
years. Also the relevance of the complex so- 
cial organization, and the concomitant net- 
work of interactions in supporting altruistic 
behavior is an open question 17|, llSl ]. 

We have proposed an evolutionary ultima- 
tum game with local interactions that self- 
organizes in a critical state. To analyze how 
social structure influences the degree of coop- 
eration we have considered different topolo- 
gies for the network of interactions. Assum- 
ing fairness as offer-acceptance around 50%, 
the amount of altruistic behavior in the Ul- 
timatum Game is reflected in the distribu- 
tion of thresholds in the population. In reg- 
ular and single-scale networks, high thresh- 
olds leading to low payoffs are removed, while 
intermediate thresholds are selected in the 
populations. In scale-free networks, the dis- 
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tribution of thresholds displays a maximum (BS model) {sl- For the one- dimensional lat- 
around a value of 50%, decaying for lower and tice, the exponents characterizing the first re- 
larger threshold values. Comparing with ex- turn time, spatial correlation and avalanche 
perimental results in small societies, both set- distribution for the ultimatum model intro- 
tings, the random and scale-free topologies, duced here are the same as for the BS-model; 
capture the experimental findings where of- for random networks, the exponent of the 
fers around 50% are the most common. How- avalanche size distributions corresponds to 
ever, in the scale-free networks the distri- the mean-field exponent of the BS model, 
bution of thresholds covers all the range of However, there is a crucial difference between 
threshold values decaying slowing from the the BS-model and the one introduced here: 
maximum around 50%, in contrast to the while in the BS-model the fitness is directly 
sharp cutoff obtained in the random case, assigned to the agents randomly from a uni- 
Thus, a hierarchical social structure may ex- form distribution. In our model, the fitness is 
plain better the patterns of offer-acceptance the outcome of the interactions and the dis- 
found in some societies [isl, [3] • tribution of thresholds is an emerging prop- 

From a dynamical point of view, in all the ^^^^ 
different complex networks we have analyzed. The results presented here complement 
including regular lattices, small-world, ran- previous theoretical works on the emergence 
dom and scale-free networks, the distribution of cooperation. Among the most used theo- 
of avalanches displays a power-law scaling retical games to study the emergence of co- 
with an exponent that depends on network operation in social sciences, the Prisoner's 
topology. This feature is typically a signa- Dilemma is perhaps the most paradigmatic 
ture of self-organized criticality. Many com- example. In this model, it has been shown 
plex systems in nature are found to display that local interactions among agents can lead 
this phenomenon 0, [l^. They characterize to a cooperative behavior in the so-called spa- 
long-range correlations in a system, similar to tial games 2^ . In evolutionary models, it 



the behavior near a critical point in a phase was also found [20| that self-organized criti- 

transition. The model introduced here can cality can be present for this system. These 

be compared with other evolutionary mod- results triggered the analysis of spatial games 

els. The exponents that characterize the dy- in different network topologies and strategies 

namics is the same as in the simple model of the agents, aiming at uncovering the condi- 



of evolution proposed by Bak and Sneppen tions under which cooperation can arise 



32|. 
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In particular scale-free networks have been 
shown to sustain cooperation [2^. Together 
with our results, hierarchical social struc- 
tures, represented for instance by scale-free 
networks of interaction, suggest that primi- 
tive societies displaying this kind of interac- 
tions favored the emergence of altruistic be- 
havior. To elucidate whether the interaction 
patterns facilitated altruism or altruistic be- 
havior led to complex interaction patterns we 
need to incorporate more realistic ingredients 
to the models as for instance the possibility 
of removal and establishment of social ties 
depending on the outcome of the interaction 
j^. Another open question is the evolution 
of empathy itself. In this work we have as- 
sumed that empathy has evolved before the 
thresholds are selected. However we expect 
that empathy will co-evolve simultaneously 
with the thresholds. Other extensions of the 
model could consider, for example, several 
repeated interactions between agents before 
selection. In this case, it could be argued 
that a repeated interaction scheme could al- 
low for an adaptation of the threshold by the 
least successful agents. The interplay be- 
tween adaptation and selection is an open 
question to be addressed in future works. 

In summary, experiments have shown that 
altruistic behavior is common in human so- 



cieties. Furthermore, it has been shown that 
social structure is a fundamental ingredient 
for understanding the distribution of shar- 
ing offers in the Ultimatum Game. We show 
that selection level together with local inter- 
actions can lead to a critical dynamics, where 
the precise degree of fair offer-acceptance de- 
pends on social structure. Recent develop- 
ments on complex networks has allowed us 
to consider some simple models capturing ba- 
sic features of networks of interaction. Our 
work emphasizes the importance of consider- 
ing the social structure and calls for the de- 
velopment of more realistic networks models 
of social interaction to understand the inter- 
play between individual behavior and with 
whom they interact. 
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